Statistical estimation from an optimization viewpoint
نویسنده
چکیده
Statistics and Optimization have been closely linked from the very outset. The search for a ‘best’ estimator (least squares, maximum likelihood, etc.) certainly relies on optimization tools. On the other hand, Statistics has often provided the motivation for the development of algorithmic procedures for certain classes of optimization problems. However, it’s only relatively recently, more specifically in connection with the development of an approximation and sampling theory for stochastic programming problems, that the full connection has come to light. This in turn suggests a more comprehensive approach to the formulation of statistical estimation questions. This expository paper reviews some of the features of this approach.
منابع مشابه
Optimal Nonlinear Estimation in Statistical Manifolds with Application to Sensor Network Localization
Information geometry enables a deeper understanding of the methods of statistical inference. In this paper, the problem of nonlinear parameter estimation is considered from a geometric viewpoint using a natural gradient descent on statistical manifolds. It is demonstrated that the nonlinear estimation for curved exponential families can be simply viewed as a deterministic optimization problem w...
متن کاملInformation Geometric Approach to Recursive Update in Nonlinear Filtering
The measurement update stage in the nonlinear filtering is considered in the viewpoint of information geometry, and the filtered state is considered as an optimization estimation in parameter space has been corresponded with the iteration in the statistical manifold, then a recursive method is proposed in this paper. This method is derived based on the natural gradient descent on the statistica...
متن کاملEfficient quadratic penalization through the partial minimization technique
Common computational problems, such as parameter estimation in dynamic models and PDE constrained optimization, require data fitting over a set of auxiliary parameters subject to physical constraints over an underlying state. Naive quadratically penalized formulations, commonly used in practice, suffer from inherent ill-conditioning. We show that surprisingly the so-called partial minimization ...
متن کاملUhlmann’s parallelism in quantum estimation theory
Two important classes of the quantum statistical model, the locally quasi-classical model and the quasi-classical model, are introduced from the estimation theoretical viewpoint, and they are characterized geometrically by the vanishing conditions of the relative phase factor (RPF), implying the close tie between Uhlmann parallel transport and the quantum estimation theory.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Annals OR
دوره 85 شماره
صفحات -
تاریخ انتشار 1999